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of cameras, for dynamically adjusting the current view of each one or more cameras 
in a second set of movable cameras, distinct from the first set of stationary cameras, 
wherein each movable camera is automatically directed without user intervention to 
maintain an independent view of one or more participants and / or objects, where the 
second set of movable cameras continuously outputs a second stream of video images, 
and where the second stream of video images is not used to either determine any 
participant's or object's centroid X, Y coordinates or to otherwise update the tracking 
datahase. 

CJaim 98. (New) The system of claim 97 tor further providing a three dimensional model of the 
activities of at least the participants, comprising: 

a third algorithm operated on a computer system responsive to the tracking database 
and both the iirsl and second streams of video images for determining the ongoing 
relative X, Y and Z coordinates of one or more spcdlic, non-centroid locations on 
each participant and for updating the tracking database to include the additional X, Y, 
Z coordinates of all delected locations. 

Claim 99. (New) The system of claim 98 wherein the contiguous view formed by the first set of 

stationary cameras is substantially parallel to the ground surface within the predefined area. 

Claim 100. (New) The system of claim 99 further comprising: 

markers adhered onto one or more locations on each participant and / or object to be 
tracked that reflect, retroreflect or fluoresce energy, where the energy is delectable by 
the first and / or second set of cameras, and where the third algorithm now deleds the 
adhered markers and updates the tracking database with related X, Y and 7. 
axmlinalcs of each dctcclcd marker for forming the three dimensional model of each 
participants activities* 

Claim 101. (New) The system of claim 99 wherein the markers reflect, relrorefleci or fluoresce 
primarily non-visible energy and are Ihereforc substantially visibly transparent, further 
comprising: 

one or more energy sources emitting non-visible energy that is reflected or 
rerrorcflccted oft of the markers, or emitting energy thai is fluoresced in the non- 
visihle spectrum by the markers and is detectable by the first and / or second set of 
movable cameras. 
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Claim 102. (New) The system of claim 101, wherein the participants and / or objects are additionally 
identified, further comprising: 

al least one uniquely encoded marker adhered onto a top surface of each participant 
and / or object to be identified thai reflects, relroretlects or fluoresces energy, and 

a forth algorithm operated on a computer system for locating and recognizing the 
encoded markers within either the first and / or second stream of video images and for 
updating the tracking database with each participant's and / or object's identity 
matched lu its coordinates. 

Claim 103. (New) The sysiera of claim J 02 wherein the uniquely encoded markers reflect, retroreflect 
or fluoresce primarily non-visible energy and are therefore substantially visibly transparent, 
further comprising: 

one or more energy sources emillmg non-visible energy that is reflected or 
rctrorcflcctcd of! of the markers, or crniiiuig energy (hat is fluoresced in the non- 
visible spectrum by the markers and is detectable by the first and / or second set of 
movable cameras- 
Claim 104. (New) The System of claim 97, wherein the participants and / or objects are additionally 
identified, further comprising: 

al least one uniquely encoded marker adhered onto a top surface of each participant 
and / or object to be identified that rcOccts, rclroreflects or fluoresces energy, and 

a forth algorithm operated on a computer system ibr locating and recognizing the 
encoded marker* within eilher the first or second stream of video images and tor 
updating the tracking database with each participant's and / or object's identity 
matched to iu a nmlinalcs. 

Claim 105. (New) The system of claim 104 wherein the uniquely encoded markers reflect, retroreflect 
or fluoresce primarily non-visible energy and are therefore substantially visibly transparent, 
further comprising: 

one or more energy sources emitting non-visible energy thai, is reflected or 
rclroreflected off of the markers, or emitting energy that is fluoresced in ihc non- 
visible spectrum by the markers and is detectable by the first and / or second set of 
movable cameras. 
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Claim I ()6. (New) Tlie system of claim 97 for vidcoing the activities of two or more participants, 

wherein the second set of moveable cameras comprises at least two cameras and wherein 
the second set is additionally directed lo automatically reassign any one or more cameras 
currently following any one or more participants lo instead follow a different one or more 
participants based upon which camera views may currently be blocked by one participant 
in front of another. 

Claim 107. (New) A system for automatically uniquely identi fying and tracking one or more 

participants, including players and game officials, as well as game objects as they move 
aboul within a predefined playing area, during a predefined time such as a sports game, 
where there is at least one uniquely encoded marker adhered onto a lop surface of each 
participant or object to be uniquely identified that reflects, relroreflects or fluoresces 
energy, comprising: 

a first set of two or more stationary cameras for generating a first video stream of 
images that together form a contiguous view that entirely covers the playing area^ 
where the first set of cameras capture video continuously throughout the entire game; 

a first algorithm operated on a computer system responsive to the first stream of video 
images tor simultaneously analyzing the continuous images from each first camera in 
order to detect the presence of any one or more participants and / or game objects 
within each and every camera's view, to determine each detected participant's and / or 
game object's relative centmid X, Y location within that view, to recognize the 
encoded markers adhered onto a lop surface of each participant and / or object thereby 
determining each participant's and / or object's unique identity, whore dimensional 
characteristics of each detected participant and / or game object, such as its sfoc, may 
also be determined during the process, and for continuously throughout the entire 
game combining this determined information from each and every first set camera 
into a tracking database of at least the ongoing ccntroid X, Y coordinates of each one 
or more marked participants and / or game objects matched wiih their identities, as 
well as the ongoing centroid X, Y coordinates of one or more non-marked game 
objects, all relative to the entire playing urea. 

Claim jas. (New) The system of claim 107 for further automatically vidcoing the one or more 

participants as well as game objects as they move about within the predefined playing area, 
during the predefined time, further comprising: 
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a second algorithm operated on a computer system responsive to the tracking 
database, for dynamically adjusting the current view of each one or more cameras in a 
second set of movable cameras, distinct from the first set of stationary cameras, 
wherein each movable camera is automatically directed without user intervention to 
maintain an independent view of one or more participants and / or game objects, 
where the second set of movable cameras continuously outputs a second stream of 
video images* 

Claim 1 09. (New) The system of claim 1 08 for further providing a three dimensional model of the 

activities of at least the participants, where markers are adhered onto one or more locations 
on each participant and / or game objects to be modeled thai rellcct, retroreflect or fluoresce 
energy and where the energy is detectable by the first and / or second set of cameras, 
comprising; 

a third algorithm operated on a computer system responsive to the tracking database 
and either or both the first and second streams of video images for first detecting the 
adhered markers and second updating the tracking database with related X, Y and Z 
coordinates of each delected marker for forming the three dimensional model of at 
least the participant's activities. 

Claim 110. (New) The system of claim 109 wherein the markers reflect, retroreflect or fluoresce 
primarily non-visible energy and are therefore substantially visibly transparent, further 
comprising: 

one or more energy sources emitting non-visible energy throughout the playing area 
that is reflected nr rclroTcllccled oil of the markers, or emitting energy throughout the 
playing area that is fluoresced in the non-visible spectrum by the markers and is 
detectable by the first and / or second set of movable cameras. 

Claim 111. (New) A method for automatically videoing I he activities of one or more participants and 
objects as they move about within a predefined area* during a predefined time, comprising 
the steps of: 

capturing a first stream of video images using a first set of two or more stationary 
cameras, wherein the combined view from all first cameras covers the entire 
predefined area, and where each first camera provides images continuously 
throughout the predefined time; 
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simultaneously analyzing only the continuous images coming from each first camera 
in order to first detect the presence of any one or more participants and / or objects 
within each and every camera's view and then to second determine each detected 
participant's and / or object's relative ccntroid X, Y location within that view, where 
dimensional characteristics of each delected participant and / or object, such as its size, 
may also be determined during this step, and third for continuously during the 
predefined time combining this determined information from each and every first set 
camera into a tracking database of at least the ongoing cenlroid X, Y coordinates of 
each one or more participants and objects., relative lo the entire predefined area; 

using the continuously determined cenlroid X, Y coordinates regarding each 
participant and object, as captured by the first set of cameras, to automatically ami 
individually direct, without the aid of an user, some combination of at least the pan, 
lilt and/or zoom movements of a each camera in a second set of one or more movable 
cameras, distinct from the first set of stationary cameras, and 

capturing a continuous second stream of video images using the second set of 
automatically movable cameras, wherein the images create independent views of one 
or more of the participants ami / or objects within the predefined area. 

Claim 112. (New) The method of claim 111 for further providing a three dimensional model of the 
activities of at least the participants, comprising | he step of: 

analyzing the tracking database and Ixilh the first and second streams of video images 
lo determine the ongoing relative X, Y and Z coordinates of one or more specific, 
non-centroid locations on each participant and for updating the tracking database to 
include the additional X, Y, Z coordinates of all delected locations. 

Claim 1 13. (New) The method of claim 112 wherein the contiguous view formed by the first set of 

stationary cameras is substantially parallel to the ground surface wilhin the predefined area. 

Claim 114. (New) The method of claim 1 13 further comprising the steps of: 

placing markers onto one or more locations on each participant and / or object lo be 
tracked that reflect, rclroreflect or fluoresce energy; 

detecting the reflected, relroretiected or fluoresced energy, using the first and / or 
second set of cameras, in order to further determine die X, Y and Z cxxjrdinates of 
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each marker using computer based image analysis of the first aniJ second streams of 
video, and 

updating the tracking database to indicate the relative X, Y and Z coordinates of the 
detected markers matched with the rusjxx;livc participants and / or objects. 

Claim 115. (New) The method of claim 1 14 wherein the markers reflect, rctrorcilec* or fluoresce 
primarily non-visible energy and arc therefore substantially visibly transparent, further 
comprising lite step of: 

using one or more energy sources to emit non-visible energy throughout the 
predclined area, to be reflected or rclrorcflcclcd off of the markers, or emitting energy 
tliat is fluoresced in the non-visible spectrum by the markers, where the non-visible 
energy is detectable by the first and / or second SCI of cameras. 

Claim 1 16. (New) The method of claim 115 T further comprising the steps of: 

placing at least one uniquely encoded marker onto a top surface of each panicipanl 
and / or object to be identified that reflects, retrorcflects or fluoresces energy; 

detecting each unique identifier using computer based image analysis of either the first 
and / or second streams of video, and 

updating the tracking database to indicate the identity of each participant and / or 
object matched to its coordinates. 

Claim 1 17. (New) The method of claim 1 16 wherein the uniquely encoded markers reflect, rciroreflecl 
or fluoresce primarily nun- visible energy and are therefore substantially visibly transparent, 
further comprising the step of; 

using one or more energy sources to emit non-visible energy throughout the 
predefined area, to be reflected or rclroreflected off of the markers, or emitting energy 
that is fluoresced in the non-visible spectrum by the markers, where the non-visible 
energy is delectable by the first and / or second set of cameras. 

Claim 1 18. (New) The method of claim 111, further comprising the steps of: 

placing at least one uniquely encoded marker onto a top surface of each participant 
and / or object to be identified that reflects, rclroreflecls or fluoresces energy; 
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deluding each unique identifier using computer based image analysis of either the first 
and / or second streams of video, and 

updating the tracking database to indicate the identity of each participant and / or 
object matched to its coordinates. 

Claim i 19. (New) The method of claim 1 18 wherein the uniquely encoded markers reflect, retroreflccl 
or fluoresce primarily non-visible energy and are therefore substantially visibly transparent. 

Claim 1 20. (New) The method of claim 1 1 1 for vidcoing the activities of two or more participants, 
wherein the second set of movable cameras comprising at least two or more cameras and 
the step for using the detected centroid X, Y coordinates and dimensional characteristics 
regarding each participant to automatically and individually direct some combination oi al 
least the pan, tilt and/or zoom movements of a each second camera further comprises the 
step of dynamically considering the location of each participant with respect to the view of 
each second camera and automatically reassigning any one or more second cameras 
cur really following any one or more participants to instead follow a different one or more 
participants based upon which camera views may currently be blocked by one participant 
in front of anotltcr. 

Claim 121. (New) A method ibr automatically uniquely identifying and tracking one or more 

participants, including players and game officials, as well as game objects as they move 
about within a predefined playing area, during a predefined lime such as a sports game, 
comprising the steps of: 

placing at least one uniquely encoded marker adhered onto a lop surface of" each 
participant and / or game object to be uniquely identified, prior to the predefined time, 
that reflects, rctrorcflccts or fluoresces energy; 

generating a first video stream of images using a first set of two or more stationary 
cameras that together form a contiguous view that entirely covers the playing area, 
where the first set of cameras capture video continuously throughout the entire game; 

simultaneously analyzing the continuous images from each first camera in order to 
detect the presence of any one or more participants and / or game objects within each 
and every camera's view, to determine each detected participant's and / or game 
object's relative centroid X, Y location within that view, to recognize the encoded 
markers adhered onto a top surface of each participant thereby determining each 
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participant's unique identity,, where dimensional characteristics of each detected 
participant and / or game object, such us its size, may also be determined during the 
process, and tor continuously throughout the entire game combining this determined 
information from eueh and every first set camera into a tracking database of at least 
the ongoing CCiUroid X, Y coordinates of each one or more marked participants and / 
or game objects matched with their identities, as well as the ongoing centroid X, Y 
coordinates nf one or more non-marked game objects, all relative to the entire playing 
area. 

Claim 122. (New) The method of claim 1.21 for further automatically videoing the one or more 

participants as well as game objects as they move about within the predefined playing area, 
during the predefined lime, further comprising ihc step of: 

dynamically adjusting the current view of each one or more cameras in a second set of 
movable cameras, distinct from the first set of stationary cameras, wherein each 
movable camera is automatically directed based upon the tracking database without 
user intervention to maintain an independent view of unc or more participants and / or 
game objects, where the second set of movable cameras continuously outputs a 
second stream of video images. 

Claim 1 23. (New) The system of claim 122 for further providing a three dimensional model of the 
activities of at least the participants, further comprising tlic steps of: 

adhering markers onto one or more locations on each participants and / or game 
objects to be modeled that reflect, retroreflect or fluoresce energy, where the energy is 
detectable by the first and / or second set oi cameras, and 

detecting the adhered markers willun either or both the first and second streams of 
video images and updating the tracking database with related X, Y and Z coordinates 
ol each detected marker for forming the three dimensional model of at least the 
participant's activities. 

Claim 124. (New) 't he method of claim 123 wherein the markers reflect, retrore fleet or fluoresce 
primarily non-visible energy and are therefore substantially visibly transparent, further 
comprising the Step of: 

using one tir itkjtc energy sources to emit non-visible energy throughout the playing 
area that is reflected or relroreflected off of the markers, or emitting energy throughout 
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